Music has always been a very important part of our lives, and we can easily fall in love with songs without knowing the lyrics. However, a well-written lyric should always be adored as it is a primary tool for the listeners to connect with the songwriter. Being able to understand the words of the lyrics, we can access to what is in their mind. It is so intuitive, and we do not need to be trained to read it. Then, what can lyrics tell us? In this context, we will analyze a large set of lyrics and discover some potential information through data visualization. In this report, we will narrow down to two main characterstcs: the genre and the decades when the songs were published.

What do we have now?

Before we start, let us take a brief look at what is provided. We will mainly study the genre of the songs and the period of the time it publised.

Song Counts

Notably, a large proportion of the songs came up in 2000s and most of the songs are rock music. Why is this happening? How about the proportion of the genres within each decades? A mosaic plot will provides a more detailed description. It plots the genres of the songs against the decades when they were published. According to the plot, Rock music accounts for a large proportion of the total music genre across all decades, and less R&B songs were published proportionally after the year 2000. In 1980s, lots of hip-hop music came up, marked a hip-hop era. Later, in 2010s, pop music arose, and the share of rock music keeps going down through out these years.

What are the keywords?

Genre

Lyrics are combinations of words. The lyricists choose the words very carefully, as they place their hopes and thoughts in these sentenses. They are perfect mirrors for their spirit. Then, what are the keywords across all genres of the songs and did the keywords change though out the year? I count the frequency of words appeared in the lyrics with respect to our interests, and consider the most frequent word is the main topic. From previous discussion, we noticed that rock music is a major part of the song development, and let us take a lood at rock music by generating a wordcloud.

We can tell that love is a major topic in rock music, and rockers also talk about time and ill, with a lot of use of pronoun you. Rock music deals with a wide range of topics and themes. From our plot, pop music arose in 2010s, and we can take a look at how they differ from the rock music in terms of the word use.

The topic of lyrics did not change dramatically, but pop music use baby and heart more often comparing with rock music, as pop is softer and has simpler structure.

Decades

Music is like a infant, and it develops thourgh the years. The topic has been changing in different historic times. The 2000s is a decades for the song wave, and plentiful songs came up. What are the keywords for two-thousands? How about now?

> 2000s

2010s > 2010s

We can tell that the keywords are very consistent in the 2000s and 2010s. People talked about love, time, baby, and ill. Love is always a big word for all time.

Sentiment Analysis

Counts

Lyrics is a way for the lyricists to transfer their emotions. The ability of recognizing the basic emotions, like happiness and sadness is a common skill that we were born with. First, we are going to analyze the sentiments in the lyrics with NRC word-emotion lexicon. It is a collection words associated with eight emitions (anger, fear, anticipation, trust, surprise, sadness, joy, and disgust) and two sentiments (positive and negative) (“NRC Word-Emotion Association Lexicon”, n.d.)

This plot shows that the emotion word counts across from all genres. The darker the bar is, the more words counts this genre has. Here, all genres of songs emphasize on two sentiments. The rock music talks less about joy and disgust, as well as pop music; but hip-hop favors trust, fear, and anger. Meanwhile, pmetal shows a strong favor towards negative sentiment and fear emotion.

How about the sentiment counts for each different decades? There are very dark bars in 2000s, representing positive and negative sentiments, and indeed, these two sentiments are the major emotions for all time. We may notice that for different decades, the distributions of the word counts are quite similar: people prefer trust, sadness, joy, fear, anticipation, as well as anger.

Positive and Negative Sentiments

As the two sentiments appear the most, let us concentrate on these two sentiments: positive and negative. These two plots presents the value of positive counts minus negative counts, providing an overall sense of how the big emotion in the lyrics.

The first plot is grouped by the time of publishing. The sentiments were very flat before the 1990s, and after the 1990s, people will use strong emotion words to express their thoughts.

The second plot is grouped by the genres of the songs. Note that hip-hop and metal songs have strong favor for negative sentiment, while jazz shows a favor for positive sentiment. Also, electronic, folk, and rock music have cases where the lyricists expressed extreme emotions.

Overall Sentiment Score

After analyzing two sentiments, we will focus on the sentiment scores based on our interest. The sentiment score represents the overall sentiment of the lyrics, and it should be consitent with our analysis above.

sentiment score plot for decades

sentiment score plot for decades

The first plot represents the sentiments score for time of publishing, and we can notice that the points spread out more in the 2000s and 2010s, which means that the songwriters used more emotional words in this period of time.

sentiment score plot for genres

sentiment score plot for genres

The second plot represents the sentiments score for the genres. The average sentiment scores (red dot) tend to be negative for hip-hop and metal and positive for jazz, which, again, match our analysis above.

Conclusion

Refence